Solving Partially Hyper-Sensitive Optimal Control Problems Using Manifold Structure
نویسندگان
چکیده
Hyper-sensitivity to unknown boundary conditions plagues indirect methods of solving optimal control problems as a Hamiltonian boundary-value problem for both state and costate. Yet the hyper-sensitivity may imply manifold structure in the Hamiltonian flow, knowledge of which would yield insight regarding the optimal solutions and suggest a solution approximation strategy that circumvents the hyper-sensitivity. Finite-time Lyapunov exponents and vectors provide a means of diagnosing hypersensitivity and determining the associated manifold structure. A solution approximation approach is described that requires determining the unknown boundary conditions, such that the solution end points lie on certain invariant manifolds, and matching of forward and backward segments. The approach is applied to the optimal control of a nonlinear spring-mass-damper system. The approximate solution is shown to be accurate by comparison with a solution obtained by a collocation method.
منابع مشابه
Eigenvector approximate dichotomic basis method for solving hyper-sensitive optimal control problems
The dichotomic basis method is further developed for solving completely hyper-sensitive Hamiltonian boundary value problems arising in optimal control. For this class of problems, the solution can be accurately approximated by concatenating an initial boundary-layer segment, an equilibrium segment, and a terminal boundary-layer segment. Constructing the solution in this composite manner allevia...
متن کاملDichotomic basis approach to solving hyper-sensitive optimal control problems
As a step toward developing a general method for determining the underlying geometric structure of two timescale optimally controlled nonlinear systems, we define a degenerate class of two timescale optimal control problems, called completely hyper-sensitive problems, and propose an indirect solution method for this class of problems. The method uses a dichotomic basis to split the Hamiltonian ...
متن کاملA Method for Solving Optimal Control Problems Using Genetic Programming
This paper deals with a novel method for solving optimal control problems based on genetic programming. This approach produces some trial solutions and seeks the best of them. If the solution cannot be expressed in a closed analytical form then our method produces an approximation with a controlled level of accuracy. Using numerical examples, we will demonstrate how to use the results.
متن کاملManifold Representations for Continuous-State Reinforcement Learning
Reinforcement learning (RL) has shown itself to be an effective paradigm for solving optimal control problems with a finite number of states. Generalizing RL techniques to problems with a continuous state space has proven a difficult task. We present an approach to modeling the RL value function using a manifold representation. By explicitly modeling the topology of the value function domain, t...
متن کاملSolving infinite horizon optimal control problems of nonlinear interconnected large-scale dynamic systems via a Haar wavelet collocation scheme
We consider an approximation scheme using Haar wavelets for solving a class of infinite horizon optimal control problems (OCP's) of nonlinear interconnected large-scale dynamic systems. A computational method based on Haar wavelets in the time-domain is proposed for solving the optimal control problem. Haar wavelets integral operational matrix and direct collocation method are utilized to find ...
متن کامل